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FIELD OF THE INVENTION 

The present invention relates to an image processing method and apparatus and, in particular, 
discloses a process for Utilising Autofocus^iformation in a43igitallfhage-€&mera. 

BACKGROUND OF THE INVENTION 

Recently, digital cameras have become increasingly popular. These cameras normally operate 
by means of imaging a desired image utilising a charge coupled device (CCD) array and storing the 
imaged scene on an electronic storage medium for later down loading onto a computer system for 
subsequent manipulation and printing out. Normally, when utilising a computer system to print out an 
image, sophisticated software may be available to manipulate the image in accordance with 
requirements. 

Unfortunately such systems require significant post processing of a captured image and 
normally present the image in an orientation ;ter which is was taken, relying on the post processing 
process to perform any necessary or required modifications of the captured image. 



SUMMARY OF THE INVENTION /y ^X^o6 

It is an object of the present invention to provide a>4Gea»&-for enhanced processing of images 



captured by a digital camera utilising autofocus in formation . 

In accordance with a first aspect of the present invention there is provided a method o f 
p r oc e ssing a digital image comprising : 

capturing the image utili s ing an adju s tabl e focusing technique ; 

utilising the focusing settings as an indicator of the po s ition of s tr u cture s within the imago ; 

id 

printing out the image . 

r ably the image can be ca pturcd^ifem g - a - zo Q m iftg-teGhni^ 
eon be, used in a heuristic manner so as to proc e ss portions of said imag e. 




BRIEF DESCRIPTION OF THE DRA WINC^ 

Notwithstanding any other forms which may fall within the scope of the present invention, 
preferred forms of the invention will now be described, by way of example only, with reference to the 
accompanying drawings which: 
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Fig. 1 illustrates the method of the preferred embodiment. 



DESCRIPTION OF PREFERRED AND OTHER EMBODIMENTS 

The preferred embodiment is preferab^ implemented through suitable programming of a hand held 
camera device such as that described in the concurrently filed application entitled "A Digital Image 
Printing Camera with Image Processing Capability" filed concurrently herewith by the present 
applicant the content of which is hereby specifically incorporated by cross reference and the details of 
which, and other related applications are set out in the tables below. 

The aforementioned patent specification discloses a camera system, hereinafter known as an 
"Artcam" type camera, wherein sensed images can be directly printed out by an Artcam portable 
camera unit. Further, the aforementioned specification discloses means and methods for performing 
various manipulations on images captured by the camera sensing device leading to the production of 
various effects in any output image. The manipulations are disclosed to be highly flexible in nature 
and can be implemented through the insertion into the Artcam of cards having encoded thereon 
various instructions for the manipulation of images, the cards hereinafter being known as Artcards. 
The Artcam further has significant onboard processing power by an Artcam Central Processor unit 
(ACP) which is interconnected to a memory device for the storage of important data and images. 

In the preferred embodiment, autofocus is achieved by processing of a CCD data stream to 
ensure maximum contrast. Techniques for determining a focus position based on a CCD data stream 
are known. For example, reference is made to "The Encyclopedia of Photography" editors Leslie 
Stroebel and Richard Zakia, published 1993 by Butterworth-Heinemann and "Applied Photographic 
Optics" by London & Boston, Focal Press, 1988. These techniques primarily rely on measurements of 
contrast between adjacent pixels over portions of an input image. The image is initally processed by 
the ACP in order to determine a correct autofocus setting. 

This autofocus information is then utilised by the ACP in certain modes, for example, when 
attempting to locate faces within the image, as a guide to the likely size of any face within the image, 
thereby simplifying the face location process. 

Turning now to Fig. 1, there is illustrated 1 an example of the method utilised to determine 
likely image characteristics for examination by a face detection algorithm. 

Various images eg. 2, 3 and 4 are imaged by the camera device. As a by product of the 
operation of the auto-focusing the details of the focusing settings are stored by the ACP. Additionally, 
a current position of the zoom motor is also utilised 6. Both of these settings are determined by the 
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ACP. Subsequently^ the ACP applies any analysis techniques 8 to the detected values before 
producing an output^having a magnitude corresponding to the likely depth location of objects of 
interest within the image. 

Next, the depth value is utilised in a face detection algorithm 10 running on the ACP^£ in g > 
addition to the inputted sensed image 1 1 so as to locate objects within the image. A closed ange value 
^indicates a high probability of a portrait image, a medium range indicates a high probability of a 
group photograph and a further range indicates a higher probability of a landscape image. This 
probability information can be utilised as an aid for the face detection algorithm and also can be 
utilised for selecting between various parameters when producing "painting" effects within the image 
or painting the image with clip arts or the like, with different techniques or clip arts being applied 
depending on the distance to an object. 

It would be appreciated by a person skilled in the art that numerous variations and/or 
modifications may be made to the present invention as shown in the specific embodiment without 
departing from the spirit or scope of the invention as broadly described. The present embodiment is, 
therefore, to be considered in all respects to be illustrative and not restrictive. 

The present invention is father best utilized in the Artcam device, the details of which are set 
out in the following paragraphs although it is not restricted thereto. 
Ink Jet Technologies 

The embodiments of the invention use an ink jet printer type device. Of course many different 
devices could be used. However presentiy popular ink jet printing technologies are unlikely to be 
suitable. 

The most significant problem with thermal ink jet is power consumption. This is 
approximately 100 times that required for high speed, and stems from the energy-inefficient means 
of drop ejection. This involves the rapid boiling of water to produce a vapor bubble which expels 
the ink. Water has a very high heat capacity, and must be superheated in thermal ink jet 
applications. This leads to an efficiency of around 0.02%, from electricity input to drop momentum 
(and increased surface area) out. 

The most significant problem with piezoelectric ink jet is size and cost. Piezoelectric 
crystals have a very small deflection at reasonable drive voltages, and therefore require a large area 
for each nozzle. Also, each piezoelectric actuator must be connected to its drive circuit on a separate 
substrate. This is not a significant problem at the current limit of around 300 nozzles per print head, 
but is a major impediment to the fabrication of pagewide print heads with 19,200 nozzles. 
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Ideally, the ink jet technologies used meet the stringent requirements of in-camera digital color 
printing and other high quality, high speed, low cost printing applications. To meet the requirements of 
digital photography, new ink jet technologies have been created. The target features include: 

low power (less than 10 Watts) 

high resolution capability (1,600 dpi or more) 

photographic quality output 

low manufacturing cost 

small size (pagewidth times minimum cross section) 
high speed (< 2 seconds per page). 

All of these features can be met or exceeded by the ink jet systems described below with 
differing levels of difficulty. 3$ different ink jet technologies have been developed by the Assignee to 
give a wide range of choices for high volume manufacture. These technologies form part of separate 
applications assigned to the present Assignee as set out in the table b^dw. /i2e^\ee^ 4& £z£a}^c^ fyftfieos<*z3> 

The ink jet designs shown here are suitable for a wide range of digital printing systems, from 
battery powered one-time use digital cameras, through to desktop and network printers, and through to 
commercial printing systems 

For ease of manufacture using standard process equipment, the print head is designed to be a 
monolithic 0.5 micron CMOS chip with MEMS post processing. For color photographic applications, 
the print head is 100 mm long, with a width which depends upon the ink jet type. The smallest print 
head designed is U38, which is 0.35 mm wide, giving a chip area of 35 square mm. The print heads 
each contain 19,200 nozzles plus data and control circuitry. 

Ink is supplied to the back of the print head by injection molded plastic ink channels. The 
molding requires 50 micron features, which can be created using a lithographically micromachined 
insert in a standard injection molding tool. Ink flows through holes etched through the wafer to the 
nozzle chambers fabricated on the front surface of the wafer. The print head is connected to the camera 
circuitry by tape automated bonding. 
Tables of Drop-on-Demand Ink Jets 

Eleven important characteristics of the fundamental operation of individual ink jet nozzles 
have been identified. These characteristics are largely orthogonal, and so can be elucidated as an 
eleven dimensional matrix. Most of the eleven axes of this matrix include entries developed by the 
present assignee. 

The following tables form the axes of an eleven dimensional table of ink jet types. 
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Actuator mechanism (18 types) 
Basic operation mode (7 types) 
Auxiliary mechanism (8 types) 

Actuator amplification or modification method (17 types) 
Actuator motion (19 types) 
Nozzle refill method (4 types) 

Method of restricting back-flow through inlet (10 types) 
Nozzle clearing method (9 types) 
Nozzle plate construction (9 types) 
Drop ejection direction (5 types) 
Ink type (7 types) 

The complete eleven dimensional table represented by these axes contains 36.9 billion 
possible configurations of ink jet nozzle. While not all of the possible combinations result in a 
viable ink jet technology, many million configurations are viable. It is clearly impractical to 
elucidate all of the possible configurations. Instead, certain ink jet types have been investigated in 
detail. These are designated UOl to U45 a>^. -fa^^^^s- W^^^^^ ^^S^uLs 

Other ink jet configurations can readily be derived from these 4*examples by substituting 
alternative configurations along one or more of the 1 1 axes. Most of the ET01 to LI45 examples can 
be made into ink jet print heads with characteristics superior to any currently available ink jet 
technology. 

Where there are prior art examples known to the inventor, one or more of these examples are 
listed in the examples column of the tables below. The IJ01 to IJ45 series are also listed in the 
examples column. In some cases, a -printer may be lrsled more than once in a table, where it shares 
characteristics with more than one entry. 

Suitable applications for the ink jet technologies include: Home printers, Office network 

printers, Short run digital printers, Commercial print systems, Fabric printers, Pocket printers, 

Internet WWW printers, Video printers, Medical imaging, Wide format printers, Notebook PC 

printers, Fax machines, Industrial printing systems, Photocopiers, Photographic minilabs etc. 

The information associated with the aforementioned 1 1 dimensional matrix are set out in the 
following tables. 
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Actuator mechanism (applied only to selected ink drops) 



Description 



Advantages 



Disadvantages 



Examples 



Thermal 
bubble 



An electrothermal 
heater heats the ink to 
above boiling point, 
transferring significant 
heat to the aqueous 
ink. A bubble 
nucleates and quickly 
forms, expelling the 
ink. 

The efficiency of the 
process is low, with 
typically less than 
0.05% of the electrical 
energy being 
transformed into 
kinetic energy of the 
drop. 



♦ Large force 
generated 

♦ Simple construction 

♦ No moving parts 

♦ Fast operation 

♦ Small chip area 
required for actuator 



♦ High power 

♦ Ink carrier limited to 
water 

♦ Low efficiency 

♦ High temperatures 
required 

♦ High mechanical 
stress 

♦ Unusual materials 
required 

♦ Large drive 
transistors 

♦ Cavitation causes 
actuator failure 

♦ Kogation reduces 
bubble formation 

♦ Large print heads 
are difficult to 
fabricate 



♦ Canon Bubblejet 
1979 Endo et al GB 
patent 2,007,162 

♦ Xerox heater-in-pit 
1990 Hawkins et al 
USP 4,899,181 

♦ Hewlett-Packard TU 
1982 Vaught et al 
USP 4,490,728 



Piezo- 
electric 



A piezoelectric crystal 
such as lead 
lanthanum zirconate 
(PZT) is electrically 
activated, and either 
expands, shears, or 
bends to apply 
pressure to the ink, 
ejecting drops. 



♦ Low power 
consumption 

♦ Many ink types can 
be used 

♦ Fast operation 

♦ High efficiency 



♦ Very large area 
required for actuator 

♦ Difficult to integrate 
with electronics 

♦ High voltage drive 
transistors required 

♦ Full pagewidth print 
heads impractical 
due to actuator size 

♦ Requires electrical 
poling in high field 
strengths during 
manufacture 



♦ Kyser et al USP 
3,946,398 

♦ Zoltan USP 
3,683,212 

♦ 1973 Stemme USP 
3,747,120 

♦ Epson Stylus 

♦ Tektronix 

♦ IJ04 



Electro- 
strictive 



An electric field is 
used to activate 
electrostriction in 
relaxor materials such 
as lead lanthanum 
zirconate titanate 
(PLZT) or lead 
magnesium niobate 
(PMN). 



♦ Low power 
consumption 

♦ Many ink types can 
be used 

♦ Low thermal 
expansion 

♦ Electric field 
strength required 
(approx. 3.5 V/jxm) 
can be generated 
without difficulty 

♦ Does not require 
electrical poling 



♦ Low maximum 
strain (approx. 
0.01%) 

♦ Large area required 
for actuator due to 
low strain 

♦ Response speed is 
marginal (-10 ^is) 

♦ High voltage drive 
transistors required 

♦ Full pagewidth print 
heads impractical 
due to actuator size 



♦ Seiko Epson, Usui 
et all JP 253401/96 

♦ IJ04 
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